Stochastic Curtailment in Adaptive Mastery Testing: Improving the Efficiency of Confidence Interval–Based Stopping Rules

نویسندگان

  • Matthew D. Finkelman
  • Jay Bartroff
  • Nathan A. Thompson
چکیده

A well-known stopping rule in adaptive mastery testing is to terminate the assessment once the examinee’s ability confidence interval lies entirely above or below the cut-off score. This article proposes new procedures that seek to improve such a variable-length stopping rule by coupling it with curtailment and stochastic curtailment. Under the new procedures, test termination can occur earlier if the probability is high enough that the current classification decision remains the same should the test continue. Computation of this probability utilizes normality of an asymptotically equivalent version of the maximum likelihood ability estimate. In two simulation sets, the new procedures showed a substantial reduction in average test length while maintaining similar classification accuracy to the original method.

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Frequentist evaluation of group sequential clinical trial designs.

Group sequential stopping rules are often used as guidelines in the monitoring of clinical trials in order to address the ethical and efficiency issues inherent in human testing of a new treatment or preventive agent for disease. Such stopping rules have been proposed based on a variety of different criteria, both scientific (e.g. estimates of treatment effect) and statistical (e.g. frequentist...

متن کامل

Application of Sequential Probability Ratio Test to Computerized Criterion-Referenced Testing

The adaptive testing is an important testing method in the modern educational/psychological testings. In adaptive mastery testing, the items are selectly adaptively according to the estimated information of the unknown latent ability levels, and given then to the test-takers, sequentially. Hence, the decision (master or non-master; pass or fail) for each test-taker is made sequentially based on...

متن کامل

Two-stage Stopping Procedures Based on Standardized Time Series

We propose some new two-stage stopping procedures to construct absolute-width and relative-width confidence intervals for a simulation estimator of the steady-state mean of a stochastic process. The procedures are based on the method of standardized time series proposed by Schruben and on Stein’s two-stage sampling scheme. We prove that our two-stage procedures give rise to asymptotically valid...

متن کامل

Exact hypothesis testing and confidence interval for mean of the exponential distribution under Type-I progressive hybrid censoring

 ‎Censored samples are discussed in experiments of life-testing; i.e‎. ‎whenever the experimenter does not observe the failure times of all units placed on a life test‎. ‎In recent years‎, ‎inference based on censored sampling is considered‎, ‎so that about the parameters of various distributions such as ‎normal‎, ‎exponential‎, ‎gamma‎, ‎Rayleigh‎, ‎Weibull‎, ‎log normal‎, ‎inverse Gaussian‎, ...

متن کامل

Heuristic Rules for Improving Quality of Results from Sequential Stochastic Discrete-Event Simulation KRZYSZTOF PAWLIKOWSKI, DONALD MCNICKLE and JONG-SUK

Sequential analysis of output data during stochastic discrete-event simulation is a very effective practical way of controlling statistical errors of final simulation results. Such stochastic sequential simulation evolves along a sequence of consecutive checkpoints at which the accuracy of estimates, usually conveniently measured by the relative statistical error, defined as the ratio of the ha...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

عنوان ژورنال:

دوره   شماره 

صفحات  -

تاریخ انتشار 2015